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ABSTRACT 


The time-optimal control law as a function of the states for second and third-order 


linear regulators with real eigenvalues was derived. Notions of a switching curve for the 


second-order system and switching surface for the third-order system was introduced. A set 
of states was found which divided the state space into two distinct regions, in one of which 


the time-optimal control was +1 and in the other of which the time-optimal control was -1, 
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I. INTRODUCTION 


The study of specific time-optimal systems has been continuing in the development of 
modern control theory. To solve an optimization problem, we must first define a goal or a 
cost function (performance measure) for the process we are trying to optimize. With a 
knowledge of the cost function, and the system states and parameters, we can determine the 


control which minimizes (or maximizes) the cost function. For some systems a criterion of 


minimum response time may not be the most suitable measure of system performance. 


In this thesis, a minimum-time control for a linear, time invariant third-order regulator 
with three distinct, nonpositive, real eigenvalues is developed. The time-optimal control, as 
a function of the states, must transfer the system from any arbitrary initial condition to a target 


set (origin of the state space) as quickly as possible. 





Il. MINIMUM-TIME CONTROL 


The goal in a minimum-time problem is to transfer the state of the system to a target 
set as quickly as possible. We assume that the target set is the origin of the state space. For 


this reason we call this problem the finear time-optimal regulator problem. [Ref. 1] 


A. PROBLEM STATEMENT 
Consider the dynamical system 
%(Q) = Ax() + Bud) (2.1) 
where the n-vector x(#) is the state, the system matrix A and the gain matrix B are nxn and 
nx m constant matrices, respectively. The m-vector u(¢) is the control. 
We assume that the system (2.1) is completely controllable and that the components ofu(4 
are bounded in magnitude by the relation 
|ufO| <1 F = UZ (2.2) 
Given that at the initial time ¢ = 0, the initial state of the system is 
x(0) = €, (2.3) 
we are asked to find the control w *(@ that transfers the system from & to the origin @ in 
minimum time. [Ref. 1] 
If the output y(¢) of the system (2.1) is related to the state x(¢) and the control a(¢) by 


the relation 


y() = Cx()+Du() (2.4) 


then a control that drives the states to the origin can be extended in such a way as to drive the 
output to zero and hold it at zero thereafter [Ref. 1]. If ¢* denotes the minimum time required 


to force the states to the origin, then at ¢ = ¢*, we have 


x( = 0 
y= 0 


where the control is set 


u(t) = 0 


B. NECESSARY CONDITIONS FOR THE TIME-OPTIMAL CONTROL 


Performance Measure 

In order to evaluate the performance of a system quantitatively, we must select 
a performance measure. An optimal control is defined as one that minimizes (or maximizes) 
the performance measure. Mathematically, the performance measure to be minimized for the 


minimum-time problems is defined as 


Pontryagin's Minimum Principle 
The Hamiltonian function for the problem is 
A[x(4),p,u,t] = 1+p (Ax) +p (O Bul (2.8) 
where p(¢) is the costate vector. Let us assume that a time-optimal control exists and 
transfers the initial state (2.3) to the origin © in minimum time ¢”. If x 7(@ denotes the 


optimal state trajectory of the system (2.1) corresponding to uw °(@, originating at — at 


ft, = © and hitting the origin in minimum time, then x *(4) and p °(é) need to satisfy the 


canonical equations given by 





2r(g = GH12"OP"O4"Ot) (2.9) 


ap “() 
or equivalently 
£°() = Ax"()+Bu“() (2.10) 
and 
PY -0H “(e %, “ > ¥ et 
po = [x°@,P “(4 °O,4) (2.11) 
ax *(¢) 
or equivalently 
p*() = -A™p“() (2.12) 
with the boundary conditions 
x°(0)=F (2.13) 
x*(t")=0 
The necessary condition for all admissible controls u(@) V ¢ € [0,¢"] is 
L+p""()Ax "(+p "Bu "() < 1+p"(QAx"(O +P OBu) Gy 


In other words a necessary condition for « *(¢) to minimize the performance measure J is 


A[x "(9p *(0,4 "(0,4 < A[x*(O.p “(9,4(0)6) Vee [0,¢°] (2.95) 


Equation (2,14) yields the relation 


u*(t) = -sign{B"p*()} (2.16) 


Equation (2.15), which indicates that an optimal control must minimize the Hamiltonian, is 
called Pontryagin’s minimum principle [Ref. 2]. Let us now state some important theorems 
concerning the time-optimal control. 

a. Controllability 


Controllability is very important, because we consider problems in which the 


goal is to transfer a system from an arbitrary initial state to the origin while minimizing the 


performance measure. Thus controllability of the system is a necessary condition for the 


existence of a solution. 
A linear, time-invariant system is controllable if and only if the n x mn matrix 
Q = [B|AB|A*Bl.....|A""'B] (2.17) 
has rank » (order of the system). If there is only one control input (m = 1), a necessary and 


sufficient condition n x n matrix @ to be nonsingular. 


b. Observability 
A linear, time-invariant system is observable if and only if the n x qn matrix 
R = [C™|A7C?|...|(A C7] el) 


has rank ». If there is only one output (q = 1), a necessary and sufficient condition for 


observability is that R to be nonsingular. 


c. Existence 


If all of the eigenvalues of the system matrix A have nonpositive real parts, 


then an optimal control exists and it is bang bang. 





d. Uniqueness 
If an extremal control exists, then it is unique. A control which satisfies the 


necessary conditions in equations (2.9) through (2.15) is called an extremal control. 


e. Number of Switchings 
If the eigenvalues of the system matrix A are all real and a unique time- 


optimal control exists, then the control can switch at most n-/ times. 


lil. TIME-OPTIMAL CONTROL OF A SECOND-ORDER 


PLANT WITH TWO TIME CONSTANTS 


A. TIME-OPTIMAL SYSTEMS 

The problems we consider in this and the next chapter will involve a single control 
variable u{¢). The systems we examine are time-invariant, and the control is to be a function 
of the states. Time-optimal control will be a piecewise constant function of time over the sets 
or regions of the state space. These sets are separated by curves in two-dimensional space, 
and by surfaces in three-dimensional space. The separating sets are called switching curves, 
and swiiching surfaces. (Ref. 1] 

The procedure that will be used in finding the optimal control for both second and third 


order regulator problems can be outlined as follows : 


Define the problem precisely 
_ @ Form the Hamiltonian function 
®@ Find the H-minimal control 
@ Find the equations of the costate variables 
® Determine the contro! sequences that are candidates for the optimal control 


@ Determine the switching curves and switching surfaces that divide the state space into 
various regions 


® Find the control sequences that satisfy the boundary conditions 


@ Simulate the /inear time-optimal regulator with initial conditions emanating from each 
possible region of the state space. 


1. Problem Definition 
We consider the system described by the second-order differential equation 
2 
£90 (a +p) 2O + anyon = ue G.1) 
de? dt 
where y(@) is the output, a(@ is the control which is restricted in magnitude by the relation 
ju(| < 1 (3.2) 


and « , B are real, distinct, nonzero eigenvalues. The transfer function of the system is 


2) gi : 


U(s) ” (@+aye+B) 63) 


with real poles ats=-a@ ands=-f . Using Eqn. (3.3) the state space equations can be written 


in matrix form as 





0 0 
= + 3.4 
0) ke «te ag| 2 A ud (3.4) 
Note that Eqn. (3.4) is of the form 
IO = Ay(O+Buld) (3.5) 


First we need to check the controllability and the observability of the system. 


o-f 1 eat ® 
«ld = (ee +B) ~lo4 ie) 


Since there is only one control input and both matrices are nonsingular, the system is 


controllable and observable. Since the eigenvalues of A, -a and -B are nonpositive real 


numbers, an optimal control exists, and it is unique. 


Now, we define a matrix P whose columns are the eigenvectors of A, and a new dependent 


variable z(é) by 


x = Py 


Then, substituting for y(@ in Eqn. (3.5), we obtain 


2(0 = P-'AP+P"'Bu(d 


where P and P™! matrices are 


Eqn. (3.8) can be written in matrix form as 





or in scalar equations 





1 
z =- - —_—_ 
ee (=) “~? (3.11) 
=< = + (9) 
20 Bz,( («-p) ul 
For simplicity, we define the state variables x,(#) and x,(@ by the relations 
(9 = a(a-B)z,(9 (3.12) 
x,(Q = -B(a-B)z( “ 
Then, x,(4 and x,(d satisfy the differential equations 
4,10 ” -ax,(d - u(t) G3. 1 3) 
%,() = -Bx,(9- Buf 
or in matrix form 
“ 0 i 2 
20 = | ie 0+ a os 
Note that Eqn (3.14) is of the form 
x(Q = Ax(d+Bu(s) (3.15) 


Figure (3.1) illustrates in block diagram form, the linear transformation necessary to obtain 


x,(4 and x,(4 from y,(@ and y,(4. [Ref. 1] 
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Figure 3.1. Block diagram of the linear transformation between x and y variables 


We have thus transferred the original system (3.5) into an equivalent uncoupled 
system (3.15) using similarity transformations. Note that existence and uniqueness of time- 


optima! control holds also for the system (3.15). 


Hamiltonian, H-Minimal Control, and the Equations of the Costate 
Variables 
Let us write the Hamiltonian for this particular problem, We have 
A = 1-ax,()p,()- Bx,(Op,1) +4O[- «Pp, - Bp.) (3.16) 
Since the Hamiltonian H 1s linear in the control vector «(@ , minimization of the Hamiltonian 


with respect to u(¢) requires that [Ref. 3] 


u(t) = sign{ap,()+ Bp} 





where the costate variables p,(4) and p,(#) satisfy the differential equations 





- oF ._ 

PO ~ ax,(0 ap,(f) 
= ): a 

PO 3x, (0 Bp, 


so that 


Substituting Eqn. (3.19) into Eqn. (3.17), we find that 


u(t) = sign{ap,(0)e“'+ Bp,(0)e"} 


(3.18) 


(3.19) 


(3.20) 


where the function g() = ap,(O)e“'+ Bp,(0)e®* has at most one zero. Therefore, we 


conclude that the four control sequences 


{+1}, {-1},€+1,-1},{-1,+1} 


are the only candidates for the time-optimal control of this system. 


3. Equation of the Switching Curve 


(3.21) 


Since, the control must be piecewise constant, we solve Eqns.(3.13) using 


u(t) = A = +1 
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to obtain the solution 


x,(Q = (&,+A)e *f-A 
x,() = (E,+A)ePt-a 


where §, = x0), i = 1,2. Eliminating the time ¢ in Eqs. (3.23) and setting 


@-F — (o<e<p) 
« 


we find that 


B+ A 


x,() = -A+(8, +4 | 


x,(0) = ¢ 


Equation (3.25) describes a trajectory in the x,x,plane. The trajectory originates at the state 
(&,.&,) and evolves as a result of the action of the constant control u(#) = A. Since the 
eigenvalues are negative, then the trajectories generated by u() = -1, which we call -/ 
forced trajectories, tend to the state (1, 1) of the state plane. The trajectories generated by 
u(é) = +1 which we call +/ forced trajectories, tend to the state (-1, -1) of the state plane 


[Ref. 1]. Since, 


where A, are the eigenvalues and A = +1. The -/ forced trajectories are shown in 
Fig.(3.2) and the +/ forced trajectories are shown in Fig.(3.3). Since the origin of the 
state space is the desired terminal state and since we must reach the origin using either 


control a = +1 or the control = -1, we isolate the two forced trajectories which pass 


nine 





through the origin. We denote these trajectories to the origin by y, andy_. More precisely, y , 


is given by 








° 
v. = {(pm): -1+@, +0) | = 0; x,>0, x,>0) (3.27) 
1+x, 
The y_ curve is given by 
1 ° 
y_ = €(x,x,): 1+, - 1) i = 0; x,<0, x,<0} (3.28) 
-x, 





Figure 3.2 -1 Forced Trajectories 
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Figure 3.3. +1 Forced Trajectories 


Using the shape of the forced trajectories shown in Figs. (3.2) and (3.3), we can 
conclude that only the control sequence { +1 } can force any state on the y, curve to the 
origin. Similarly, only the control sequence { -1 } can force any state on the y_ curve to the 


origin. Thus, we have derived the control law, 


If (x,x,)ey7, then w*(4) = +1 (3.29) 


If (xyx,)€y_ then u*(f) = -1 (3.30) 
We call the union of the y, and the y_ curves switching curve [Ref. 1]. Then 
combining Eqns. (3.27) and (3.28), the y curve is given by 


aa | 


[C1 +], ])?-1]} 
|x, | 


x = {( xx, ) 7X, = 





Switching curves in x, x, plane for uncoupled system (3.15), and in y, y, plane for the 


system (3.5) are shown in Figs. (3.4) and (3.5). 


The y switch curve 





Figure 3.4 Switching Curve for the system (3.15) 





Figure 3.5 Switching Curve for the system (3.5) 
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Let us denote the set of states to the right of the y curve as R, and the set of 


points to the left of the y curve as R_. Clearly, 


R, = {(xpx,): x,< 


+ 





*1 e_ 
[(1+]x,1)-1]} 
|x, | 
% (3.32) 
R_ = {(xpyx,): x,>—-[ (1+|x,|)°-1]} 
|x, | 


Using Eqns.(3.32), we can conclude that the control sequence { +1, -1 } can force any 
state belonging to set R, to the origin, and contro] sequence { -1, +1 } can force any state 
belonging to set R_ to the origin. Then, time-optimal control, as a function of the state 


(x,,x,) is given by 


iT] 


u(x ,x,) = +1 Vo (x,x,) © y, UR, 


xp a (3.33) 
= W(xpx,) = -1 Vo (xpx,) © yu RL 
or in other words, the optimal control in terms of the state variables 
x. 
u“(xpx,) = eet Cha | aa (3.34) 


x 
1 
An alternative solution to the optimal control in terms of states can be found in Ref. 4. We 


can easily obtain equations for switching curve and time-optimal control in terms of y, and 


Y2 We find that, x,(4 and x,(4 are related to y,(Q and y,(@ by 


x,(O = -a By, (4) - ay,(4 (3.35) 
x,() = -aBpy 1 be By, (4) 


The equations of the switching curve of time-optimal control are given by 


_ 7 _ ~aBy,()- ay,(O 7 7 _ 
« By, (4) - By, = Fetaticaar a By,(4) - ay,(t)|]°-1} (3.36) 


V7 


and 


p- t 
2 °,0),)=#len fay (0 * B90 2 663 + | ey, ap, C011" - 1193.37) 
|-« By, (4) 7 ay,(| 


Equation (3.36) and (3.37) demonstrate the advantage of using x,(#) and x,(#) as state 


variables 


4. Analytic Solution for the Minimum Time t’ 
We may now evaluate the minimum time ¢” required to force any initial state 
(x,,x,) to the origin (0, 0) using the time-optimal control law given by Eqns.(3.33). Let us 
consider an initial state X = (x,,x,), as shown in Fig. 3.6, and the time-optimal trajectory 


XWO to the origin, where W = (w,,w,) ison the y curve [Ref. 1]. 





Figure 3.6 Time-optimal trajectory 
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Let us assume # = A®* = +1 is the optimal control applied during the trajectory WO, t, 1s 
the time required to go from Wto OQ, and ¢, is the time required to go from X to W. Then, 


using Eqns.(3.23) we have 


(w,+A*)e “9-A* 











3.38 
O = Gu, +40 a" (3.38) 
Solving for ¢, in the above equations, we find that 
t, = --Logi —4 gl a (3.39) 
a with” B w +h” 
and from equation (3.38) we have 
. ¢ 
0 = “arte al 
wird (3.40) 
where @ = B. 
3 
Using the shape of Fig. 3.6 and Eqns. (3.29) and (3.30), we conclude that, 
A” = sign{w,} = sign{w,} 
M1 me (3.41) 
We again use Eqns. (3.23) to obtain ¢,. Then, we have 
w, = (x,-A*je +A" 
1 1 
(3.42) 


(x,- A*je M+ A* 


x 
" 
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Note that we use = -A”. Since, during the trajectory XW we have uw = -A”. Solving for 


t, in the above equation we obtain 


1 w,-A* 1 w,-A* 
t, = -—log = -—log 
: « aa B = -A* (3.43) 


and from Eqn.(3.43), we have 











Ww, * 
Be CRT Se (3.44) 


Since, ¢* = ¢,+¢,, then ¢” is given by 








. i A’ w,-A* 
t Li Te | (3.45) 


We want to find ¢” as a function of x, and x, only, so we must eliminate w, from Eqn 


(3.45). Combining Eqns.(3.40) and (3.44), we find that 





0 = -At+| 2A°%+(x,-A") mo A*)"l(_as \* 
2 are (3.46) 


which provides us a relationship between w, x, , and x, For specific values of a and B 


Eqn.(3.46) reduces to a quadratic expression. For example for a = 1 and B = 2 , we have 


Ww, = 4x,-2x,-2A° x} Y( BA “x, -16A “x, +8x7 )(1- A*x, (3.47) 
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Choosing the appropriate sign for w, and substituting into Eqn.(3.45), we can 
obtain an analytic expression in terms of the stateX = (x,,x, ). Since we know the sign of A * 
from Eqns.(3.33), we can easily obtain the switching time and the minimum time ¢*, required 


to drive any initial state to the origin 


Simulation of the Linear Time-Optimal Regulator 

Using a computer simulation, we test the accuracy of the solutions by choosing 
the initial conditions in the regions defined by Eqns.(3.32) with a = 1 and B = 2. Figure 
3 7 shows the state trajectories for the system (3.15) emanating from the region R,. Time- 
optimal! control as a function of time is shown in Fig. 3.8. As we claimed before, the control 
sequence { +1,-1} drives the states to the origin with at most n-/ switching in time-optimal 
control. State trajectories in y, y, plane are shown in Fig. 3.9. Next, we simulate the system 


(3.15) with initial conditions emanating from the region R_. State trajectories and the time- 


optimal control are shown in Fig. 3.10 and Fig. 3.11. This time, the control sequence {-1, +1} 


drives the states to the origin with at most n-/ change, in the control function as we suggested 
before. State trajectories in y, y, plane are shown in Fig. 3.12. 

The desired terminal state was the origin of the state space. Upon reaching the 
origin the control effort must be shut off in order to maintain the system at rest. In both 
simulations switching time and minimum time ¢* agree with the calculated values obtained 


from Eqns.(3.39), (3.43), (3.45), and, (3.47). 











MAGNITUDE 


Figure 3.8 Time-optimal control 
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Figure 3.10 State trajectories in x,x, plane 
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Figure 3.11 Time-optimal control 














Figure 3.12 State trajectories in y,y, plane 
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IV. TIME-OPTIMAL CONTROL OF A THIRD-ORDER 


PLANT WITH THREE REAL EIGENVALUES 


A. GENERAL 
In the previous chapter we solved the time-optimal control problem for a second-order 
plant. We showed that the time-optimal control can be determined as a function of the state 
by means of a switching curve which divides the state plane into two regions. In this chapter 
we consider the time-optimal control problem for a third-order plant with three distinct rea! 
and negative eigenvalues. 
Problem Definition 


We examine the system described by the third-order differential equation 


3 2 
£90 «(a +p + y) 220 + (ap ray +yp) PO + (apy = uO 
at? dt? dt 


(4.1) 
where «, B, and y are real, distinct, nonzero eigenvalues. The transfer function of the 


system 1S 
Y(s) _ G(s) = 1 


U(s) (s+a)(s+B)(s +) 
Using Eqn.(4.2) the state space equations can be written in matrix form as 
0 1 0 0 


yO =| 0 0 1 yO) +|0| uf) 
-aBy -(aP+ay+yB) -(a+B+y) 1 





Again, as a first step we need to check the controllability and the observability 
of the system (4.3). Since Q and R matrices, given by Eqns.(2.17) and (2.18) are both 
nonsingular, the system is controllable and observable. The eigenvalues are all nonpositive and 
real, so an optimal control exists. 


Using partial fraction expansion, we decouple the system (4.3) with P and P“! given 


by 
ge el aN) 
(B-a)(y-a) (a-B)y-B) (a-y)(B-y) 
Pp: a B ¥: (4.4) 
(c-B)(y-2) (a-B)(B-y) (a-y)y- 6) 
a2 p? y? 
(B-a)(y-a) (a@-B)(y-B) («-y)(B-y) 
and ck Bae dl 
P= lay y+a 1 (4.5) 
aB Bra 1 


As before we use Eqns.(3.7) and (3.8) to obtain 


-a 0 O 1 
20 =|0 -B 0 | H+/1/ uO (4.6) 
0 O -y 1 


where 2(¢) satisfies the differential equations 


2,19 a -a2z,() +u(4) 
2,10 = -Bz, +4 (4.7) 
2,1 = -y2,() +4 
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For simplicity, we define the uncoupled state variables x,(¢) , x,(4, and x,(¢) as 


*,( = az,() 
x,() = B24 (4.8) 
x5() = 1z,(0) 


where x,(4, x,(), and x,(¢) satisfy the differential equations 


2,( = -ax,()+au( 
2,10 = -Bx,(0 + Bu) 


2(0 = -1x,() + yu(0 4.9) 
or in matrix form 
-c 0 O 4 
x(0 =|0 -B O| x()+/B] uO 
0 oO -y Y (4.10) 


2. Hamiltonian, H-Minimal Control, and the Equations of the Costate 


Variables 


The Hamiltonian is 


H=1- ap, (4x, (t) - B p(x, (4 ~ YP; (t)x,(4) +u(O[ ap,(t) % Bp,( * yP;(4) (4 | 1) 


The control u(@ which minimizes the Hamiltonian is 


u(t) = -sign{ap,()+Bp,()+ 1P;(4 } (4.12) 


a7 


where the costate variables p,(Q, i = 1,2,3 satisfy the equations 











__ 0H 
Pi = ax, ap,(4) 
__ oH | 
P,() = ax, (0 Bp,() 
Fy: a 
BP; ax, = yp;(¢) 


so that 


P,(O = p,(0)e“* 
P,(0 = p,(0)e"* 
P,() = p,(0)e"* 


Substituting Eqn.(4.14) into Eqn.(4.12), we find that 


u() = ~ sign {ap,(0)e“' + Bp,(0)e"* + yp,(0)e"*} 


Then, the candidates for time-optimal control are the six control sequences 


{+1}, {-1},{+1,-1}, {-1,+1},{+1,-1, +1}, {-1+1,-1} 


3. | Equations of the Switching Curve and the Switching Surface 


Again, we solve Eqns.(4.9) using 


u() = A = +1 
to obtain the solutions 
x,() = (E,-A)e“*+A 
x,(0 = (E,- Ade +A 
x,(0) = (Ey-A)eV'+A 
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(4.13) 


(4.14) 


(4.15) 


(4.16) 


(4.17) 


(4.18) 


Eliminating time ¢ in Eqns.(4.18), we find that 
(9 = (&,-4)) 2 “ek 
x(t) = - —+—_| "+ 
2 2 = 


1 

eon ie (4.19) 

x,(4 e (&,- 4) y-k 
1 





Eqn.(4.19) describes a trajectory in the three-dimensional state space. From Eqn.(4.18) we 
conclude that 

Him 49-4. ¢= 123 (4.20) 
where A = +1. This means that a trajectory generated by w = +1 tends to the point (1,1,1) 
and a trajectory generated by a = -1 tends to the point (-1,-1,-1). 

Now, let { V, } denote the set of states which can be forced to the origin (0,0,0) 
of the state space by application of the control a = A*=+1. We use x, to indicate a state 
belonging to the set { V, } and x,,, x,,, 5, to indicate the components of x, . If ¢, denotes 
the positive time required to force x, to the origin using = A*=+1, then from Eqn.(4.18) 


we have 


e% (x,,-A)e Pt+ A" (4.21) 
0 = (x,,-A*)e '7+A" 

or equivalently 
Xy2 = A*-A‘e** 
x,, = A*-A*e’® 4 
2,2 (4.22) 
X32 = A*-A*e’? 
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Let { V, } denote the set of states which can be forced to the set { V, } by 
application of the control w = -A”*. Again, let vector x, indicate the states belonging to set 
{ V,} and the components of x, be x,,, ¥,,, and x,,. If, denotes the positive time required 


to force x, toastate x, € { V, }, then using Eqn.(4.18) we obtain the states belonging to 


{Vi}, 
Xi. = (+4 i a" 
= ay, BA » 
aa = ytt e e (4.23) 
Hs 2 (x,,+A "Je "-A* 
or equivalently 
x1, = -AT+ (xy +A Je" 


* 
I 


* * A 
ny = AT +(e, +A ent 


(4.24) 
a1 = A+ (x, 4A Je™™ 


tad 
a 


Thus, we have defined the sets { V,} and { V,}. Eqns. (4.22) and (4.24) imply that the 
trajectory originating at any point x, € { V,} and generated by w = -A”* will remain on the 
surface { V, } until it hits a point on the set (curve) { V; }. 

To simplify the Eqns. (4.22) and (4.24), we define new variables z,, and z, by 


4 


ye 
n= 8 (4.25) 
Using these new variables, Eqns. (4.22) and (4.24) become 
*, = A*-A*z* 
%, = A*-A‘e! (4.26) 


k 
u 


52 A*-A*z," 
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X= ~A*+(x,,+A")z," 


Xp. = ~AT+ (2+ A")z,? (4.27) 
%,, = ~A°+(x,,+A%z," 


Substituting Eqns. (4.26) in Eqns. (4.27) we obtain 


Ax, , = -1+2z,"- (,2,)" 
-1+2z,° -(z,z,)° (4.28) 
-1+2z," -(¢,z,)" 


° 
A Xa 


A "X34 


For simplicity, we define new variables w,, and w, by 
w= (4.29) 
Wy = 2% 
Since we specified the times ¢, and ¢, positive, this implies that 
1<z, i= 1,2 3%) 


where z, is given by Eqn.(4.25). Combining Eqns. (4.29) and (4.30), we obtain the inequality 


1<w,<», (4.31) 
Using the variables w, , and w, , Eqns. (4.26) and (4.28) become 

A*x,, = 1+2,"-w," 
A*x,, = 1+2w,?-w,? (4.32) 
A “xy, = 1+2w,'- w," 
A*x,, = -1+2w,"-w," 
A‘x,, = -1+2w,P-w,? (4.33) 
A*x,, = -1+2w,’-w,' 


Now, let us state some important properties of the sets { V, } and { V, }. 


Be, 


@ The sets { V, } and { V, } are symmetric about the origin. 


@ In the three-dimensional state space, the set { V,} is a curve and { V;} is a surface. 
{ V,} divides the state space into two parts. 


@ The sets { V,} and { V, } are formed by families of smooth and continuous 
trajectories. 


@ The sets { V,} and { V, } are infinite in extent. The origin is contained in the set {V,}, 
the set { V, } is contained in { V, }. 


® The state (1,1,1) is above the surface { V,}, and the state (-1,-1,-1) is below the surface 
L¥y 4 


In order to determine the optimal control law, we need to find whether the state 


x given by 


x= |x, (4.34) 


wi *p or ales (4.35) 


in the first two Eqns. of (4.33) and solve these two equations to determine the values of 
w,, w, and A* = +1 or A* = -1 . We need to satisfy the inequality given by (4.31). 
Then, we substitute the values of w, , w,, and A * in the last equation of (4.33) and evaluate 


x, ,. We can compare the computed value of. %,, with the last component of the state x. 
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If 

¥y~%3,>0 (4.36) 
then we say that x is above the surface { V, }. If 

X,-%,,=0 (4.37) 
then x € { V,}, andif 

¥y~Xy, <0 (4.38) 
then we say that x is below the surface { V, }. Figure 4.1 shows an illustration of the 
projection x, , of a state x on the surface { V, } [Ref. 1]. We draw a straight line parallel 
to the x, axis through the point x = (2,,x,,x,) which intersects the surface { V,} at a point 
X, = (X,X,,X, ,).Comparison of x, with x,, indicates whether x is above, on or below the 


surface. 


x= (,,%,.%,) 


portion of the surface { V,} 





Figure 4.1 Projection x , of the state x on the surface {V,} 


ee 





4. Optimal Control uw’ 
Time-optimal control «* , which forces any state x to the origin can be defined 
in the following way 


If x isabove{V,}then u* = (-1)" 


If x isbelow {V,} then w* = -(-1)* (4.39) 
If xis e€ {V,} then a” = (-1)"A’ 
If xis e€ {V,} thenuw” = -(-1)"A’ 


Let us show that the control law given by Eqns. (4.39) is the time-optimal one. We recall that 
if the state x belongs to { V, }, then the control switches exactly once. Since the system has 
three real eigenvalues, the time-optimal control can switch at most n-/ times. Let us consider 


the state 


x, * |I (4.40) 


which is above { V, }. Since n = 3, the control law (4.39) states that w* = -1 . Suppose that 
at x,, we apply the control u* = +1. From Eqn.(4.20), all the trajectories generated by 
u” = +1 tend to the state x,. So, the state will remain at x, forever. Therefore, to generate 
a trajectory which hits the surface { V, }, we must apply w* = -1 at x,. Ifthe control 
switches from wu = -1 tow = +1 at { V, }, the total number of switchings is n-/. This does 
not violate the necessary conditions. Now, let us consider the other states x which are above 
{ V, }. If a = +1, then x tends to the state (1,1,1), and eventually we must switch to 


u = -1 toreach { V, }. But this method requires n switchings which violates the necessary 
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conditions. Therefore, if the state is above { V,} the control must be wa = -1. By the same 
reasoning if the state is below { V,}, the control w# = +1 forces x to { V,}. In either case, 
the total number of switchings is exactly n-/. [Ref. 1] 

Now, we need to show that if state x is on { V,} but not in { V,}, the control 
must be w# = (-1)"A*. Suppose that for the point x, € { V,}, the valueof A* is -1. 
According to the control law (4.39), we must use w = +1 at x,. Application of u = +1 
generates a trajectory which follows the surface { V,} and hits { V,} at a point at which the 
control must switch to w = -1. This control sequence requires exactly one switching. 
Suppose that at x,, we apply w = -1. The resulting trajectory will not follow the surface 
{ V,}. It will go below { V,}, because, it will tend to the state (-1,-1,-1), which 1s below {V,} 
by definition The control must switch fromw = -1 to a = +1 so that the state is brought 
back to { V,}. But this control sequence requires exactly 7 switchings. So it can not be a 
time-optimal one. From the above considerations, we conclude that the control which requires 


the minimum number of switchings is the time-optimal one. [Ref. 1] 


5. Simulation of Minimum Time Control of the Third Order Regulator 
We simulate system (4.10), with initial conditions above, below, and on the 
switching surface, using e = 1, B = 2,andy = 3. Figure 4.2 shows the three-dimensional 
state trajectories emanating from an initial point above the switching surface. Time-optimal 
control is shown in Fig. 4.3. The control sequence { -1, +1, -1 } drives the states to the origin 
with exactly two switchings as we suggested before. State trajectories as a function of time 


are shown in Fig. 4.4. 





Next, we simulate the system starting from an initial condition below the 
switching surface. This time control sequence { +1, -1, +1 } drives the states to the origin, 
again with exactly two switchings. Three-dimensional state trajectories are shown in Fig. 4.5. 
Time-optimal control and the state trajectories as a function of time are shown in Figs. 4.6 
and 4.7. 

Lastly, we simulate the system starting from a point on the switching surface. 
Figure 4.8 shows the three-dimensional state trajectories. Time-optimal contro! and the state 
trajectories as a function of time are shown in Figs. 4.9 and 4.10. From Fig. 4.9 the control 
law { At, +1} drives the states to the origin with only one switching . 

All three simulations confirm that the control law given by (4.39) is the time- 
optimal control. Again, upon reaching the origin the control effort must be shut off to keep 


the system at rest. 
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Figure 4.3 Time-optimal control 
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Figure 4.4 State trajectories as a function of time 





Figure 4.5 Three-dimensional state trajectories of system (4.10) 
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Figure 4.7 State trajectories as a function of time 
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Figure 4.9 Time-optimal control 
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Figure 4.10 State trajectories as a function of time 


4l 


V. CONCLUSION 


We have examined the time-optimal control problem for one second-order and one 


third-order system. These systems had the following properties in common: 


The systems were linear, and time invariant. 
The transfer function of the system did not contain any zeros. 
The eigenvalues of the transfer function were real, nonpositive, and distinct. 


Control was effected by a single control variable u(¢) , which was bounded in 
magnitude. 


The desired terminal state was the origin, which was an equilibrium point of the system. 


Upon reaching the origin the control needed to be shut off in order to maintain the 
system at the origin. (Ref. 1] 


The method which we used to obtain the time-optimal control law was almost the same 


for each of these systems. Essential steps in our synthesis of the control were, 


We first reduced the system differential equation to a set of first order equations. 


We then chose a convenient set of state variables by means of a series of linear 
transformations which reduced the system matrix to its Jordan canonical form, 


We examined the Hamiltonian, and found the control which absolutely minimized the 
Hamiltonian. We observed that the time-optimal control had to be piecewise constant 
and could switch at most n-/ times for an mth order system. 


We then determined the control sequences which were candidates for time-optimal 
control. 


We used a method of elimination to determine the time-optimal control. We found a 


unique control sequence from among the candidates which would force a given state 
to the origin. Then we developed the control law. [Ref. 1] 
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The complexity of the controller may increase rapidly with the increase in the order of 
the system. For systems whose order is higher than three, some iterative procedure must be 
used to solve the system of transcendental equations that describe the switching hypersurface. 
Even though the equation of the switch hypersurface is complex, from a conceptual point of 
view the operation of a high-order time-optimal system presents no particular difficulty. Quite 
often, knowledge of the optimal solution can help the designer to construct an excellent 
suboptimal system. [Ref. 1] 

Negative time approach was used in Ref. 5 to determine the time-optimal control for 
a third-order system with two integrators and a single time constant. The method requires 
analytic calculations of boundary conditions for each different set of eigenvalues. The process 
of elimination among the candidates for time-optimal control reduces the complexity and 


applicable to the higher-order systems as demonstrated in previous chapter. 
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APPENDIX 


PROGRAM CODE 


1. OPTIMALX.M 

% This program simulates the 2nd order bang-bang controller using a switching law for 
% the control effort 

clear,cle,clg 

% Setting eigenvalues of the system 

alfa=l, beta=2, 

“% Ratio of the Eigenvalues 

k=(-beta)/(-alfa); 

% State Equations for the uncoupled system (x variables) 
XA=[-alfa 0;0 -beta]; XB=[-alfa -beta]'; 

% State Equations for the uncoupled system (z variables) 
ZA=[-alfa 0:0 -beta]; ZB=[(-1/(alfa-beta)) (1/(alfa-beta))]'; 

% State Equations for the coupled system (y variables) 

YA=[0 1;-alfa*beta -alfa-beta],; YB=[0 1]'; 

% Transition matrix between y (coupled) and z (uncoupled) systems 
P=[1 |,-alfa -beta]; 

% Simulation time 

tf=2, 232% 


% Time increment and number of steps for simulation 
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dt=0.001; kmax=tf/dt+1; 

% Equation of the switching curve for uncoupled system(x variables) 
x1=-1.5:0.01:1.5; 

x2=(x1./abs(x1)).*((1 +abs(x1)).%k-1); 

% Equation of the switching curve for uncoupled system(z variables) 
c=alfa*(alfa-beta), 

zl=x1l,  z2=((c.*z1)./(-beta*(alfa-beta)*(abs(c.*z1))).*((1+abs(c.*z1)).4k-1)); 
% Equation of the switching curve for coupled system(y variables) 
yl=(1/(alfa*(beta®2-alfa*beta))).*(alfa.*x2-beta.*x1); y2=(1/(alfa-beta)).*(x2-x1); 
x=zeros(2,kmax), z=zeros(2,kmax); 

y=zeros(2,kmax); u=zeros(1,kmax); 

time=zeros(1,kmax); 

% Initial conditions 

x(¢,.)=[3: 2]; 

z(.,1)=[1/(alfa*(alfa-beta))*x(1,1) -1/(beta*(alfa-beta))*x(2,1)]': 

y(:, 1IJ=P*2(:,1); 

% Discretize the Systems 

{phi,del]=c2d(XA,XB,dt); [phiz,delz]=c2d(ZA,ZB,dt), [phiy,dely]=c2d(Y A, YB, dt), 
% Begin Simulation 

for i= 1:kmax-1 

u(i)=sign(x(1,1)/abs(x(1,1))*((1+abs(x(1,i)))*k-1)-x(2,1)); 


x(:,1+1)=phi*x(:,1)+del*u(i); 
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2(.,i+1)=phiz*z(.,i)+delz*u(i); 

y(:,i+ 1 )=phiy*y(:,1)+dely*u(i); 

time(i+1)=time(i)+dt; 

end 

figure(1); plot(x1,x2,'r'); xlabel('X1');ylabel('X2’'); 

title’SWITCHING CURVE FOR UNCOUPLED SYSTEM (X VARIABLES)’, 
figure(2):plot(y 1,y2,'m’);xlabel('Y 1');ylabel('Y2'); 

title(‘SWITCHING CURVE FOR COUPLED SYSTEM (Y VARIABLES)’, 
figure(3); plot(time,u);grid; xlabel('TIME (Seconds’);ylabel(MAGNITUDE)); 
title((CONTROL EFFORT vs TIME’); 

axis({O max(time)+0.05 -1.75 1.75]); 

figure(4); plot(x(1,:),x(2,:));grid ; xlabel('X1');ylabel('X2'); 

title’STATE TRAJECTORIES AND SWITCHING LINE (X VARIABLES)’); 
hold on; plot(x1,x2,'r:'); hold off 

figure(5) 

plot(y(1,:),y(2,:)); grid; xlabel("Y 1');ylabel('Y2'), 

titleSTATE TRAJECTORIES AND SWITCHING LINE FOR COUPLED SYSTEM 
(Y VARIABLES); 

hold on ; plot(y1,y2,'r:'); 


hold off 
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2. RELAY3BT.M 
% This program simulates the time optimal control of a third order system having three 
%real distinct negative eigenvalues 
% Written by Serhat Balkan 12 April 1994 
cle,clear,clg,! del *.met, 
% Set the eigenvalues of the system 
alfa=l, beta=2; gama=3, 
% Transition matrix between y (coupled) and z (uncoupled) systems 
P=[(1/((beta-alfa)*(gama-alfa))) (1/((alfa-beta)*(gama-beta)))....... 
(1/((alfa-gama)*(beta-gama))), 
(alfa/((alfa-beta)*(gama-alfa))) (beta/((alfa-beta)*(beta-gama))).... 
(gama/((alfa-gama)*(gama-beta))); 
(alfa®2/((beta-alfa)*(gama-alfa))) (beta%2/((alfa-beta)*(gama-beta))).... 
(gama’2/((alfa-gama)*(beta-gama)))]; 
% State Equations for the uncoupled system (x variables) 
XA=[-alfa 0 0:0 -beta 0:0 0-gama]; XB=[alfa beta gama]', 
% State Equations for the uncoupled system (z variables) 
ZA=[-alfa 0 0:0 -beta 00 0-gama], ZB=[1 1 1]'; 
% State Equations for the coupled system (y variables) 
YA=[01 0,0 01: 
-alfa*beta*gama -(alfa*betatalfa*gamat+gama*beta) -(alfat+betatgama)], 


YB=[0 0 1]'; 
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% Simulation time 

tf=2.66, 

°/, Time increment and number of steps for the simulation 
dt=0.01: kmax=tf/dt+l; time=0; 

% Discretize the systems 

[phix,delx]=c2d(XA,XB,dt), [phiz,delz]=c2d(ZA,ZB, dt), [phiy,dely]=c2d(Y A, YB,dt), 
% Set initial conditions 

x(,1=[2 3 4]; 

2(:,1)=[(1/alfa)*x(1,1) (1/beta)*x(2,1) (1/gama)*x(3,1)]'; 
y(., 1)=P*z(.,1); 

i=0; 

% Order of the system 

N=3, 

% From Eqn.(4.35) set: 

xl=x(1,1), x2=x(2,1); 

% Call function to determine wl, w2 and the optimal control 
[w1,w2,deltas]=solve1b(x1,x2), 

% Calculate the third point on the switching surface 

x3 1 =deltas*(-1+2*w1gama-w2“gama); 

% Decide whether initial state above or below the switching surface 
m=x(3,1)-x31; 


% Find the optimal control which drives the states to the switching 
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% surface in min. time when states are above the switching surface 


while m > 0; 
i=i+1; 
u(ij=(-14N). 


x(.,i+1)=phix*x(:,1)+delx*u(i); 
2(.i+1)=phiz*z(.,i)+delz*u(i), 
y(.,i+ 1 )=phiy*y(.,i)+dely*u(i), 
time(it+1)=time(i)+dt, 
x1=x(1,1+1); 
x2=x(2,i+1); 
[w1,w2,deltas]=solvel b(x1,x2); 
x3 1=deltas*(-1+2*w1“gama-w2“gama), 
m=x(3,i+1)-x31, 
end, 
% Find the optimal control which drives the states to the switching surface 
% in min. time when states are below the switching surface 
while m < 0, 
i=I+1, 
u(1)=-(-14N); 
x(.,i+1)=phix*x(.,i)+delx*u(i); 
2(.,i+1)=phiz*z(:,1)+delz*u(i), 


y(:,i+1)=phiy*y(:,1)+dely*u(i), 
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time(i+1] )=time(i)+dt; 
xl=x(1,1+1); 
x2=x(2,i+1); 
[w1,w2,deltas]=solvel b(x1,x2); 
x3 1=deltas*(-1+2*w1/gama-w2*gama); 
m=x(3,i+1)-x31; 
end; 
% Find the optimal control which drives the states to the switching 
% curvce in min. time when states are on the switching surface 
if m== 
counter=1; 
else 
counter=1, 
end 
for i=counter:kmax-1; 
x1=x(1,1); 
x2=x(2,1); 
[wl ,w2,deltas]=solvelb(x1,x2); 
if (deltas*x(1,1)-1-2*wl+w2 == 0) &.... 
(deltas*x(2,i)-1-2*w12+w2’2 ==0 & deltas*x(3,1)-1-2*w1*gamatw2“gama == 0), 
u(i)=-(-1°N)* deltas; 


else 
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u(i)=(-1°N)*deltas: 

end 

x(.,i+ 1 )=phix*x(:,1)+delx*uG), 

z(.,i+1)=phiz*z(_,i)+delz*u(i), 
y(.i+ D)=phiy*y(i)+dely*ud), 
time(it 1 )=time(i)+dt: 

end 
% Plot the outputs 
plot3d(x(1,:),x(2,:),x(3,:),-45,45); 
title('3-D PLOT OF THE STATE TRAJECTORIES FOR UNCOUPLED SYSTEM 
(X VARIABLES)’, 
meta 3ax: pause,clg, 
plot(time,x(1,'),time,x(2,:),time,x(3,")), grid, 
titleSTATE TRAJECTORIES vs TIME (X VARIABLES)’, 
xlabel('TIME (seconds)');ylabel(MAGNITUDE'), 
meta 3bx,pause,clg ;axis([O max(time)+0. i -1.75 1.75]); 
plot(time( 1 ‘length(u)),u);gnd, 
xlabel(‘TIME (seconds)'):ylabel(MAGNITUDE'), 
title‘OPTIMAL CONTROL EFFORT (u(t)) vs TIME’), 
meta 3c 
axis(‘normal’), pause, 


plot3d(y(1,:).v(2.:),yG.:),75,-45), 


Bul 





title('3-D PLOT OF THE STATE TRAJECTORIES FOR COUPLED SYSTEM 
(Y VARIABLES)’); 

meta 3ay, pause,clg, 

plot(time,y(1,:),time,y(2,:),time,y(3,:)); grid, 

title(STATE TRAJECTORIES vs TIME (Y VARIBLES)’): 

xlabel('TIME (seconds)'),ylabel( MAGNITUDE’), 


meta 3by,pause,clg 
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3. SOLVEIB.M 
% Function solvelb decides the optimal control and the required time to drive the states 
% to the switching surface or to the switching curve and passes these values to the 
% main program (relay3bt.m). 
% Written by Serhat Balkan 12 April 1994 
function [wl,w2,deltas] = solve] b(x1,x2) 
delta=1, 
% al, a2, and delta are the local variables corresponding to wl, w2, and deltastar 
Yorespectively. 
[al,a2,delta]=solve2b(x 1 ,x2,delta); 
% Check if Eqn.(4.31) is satisfied or not 
if (al>1) & (a2>al) 
wl=al, = w2=a2; 
deltas=delta; 
else 
delta=-1,; 
({al,a2,delta]=solve2b(x1,x2 delta), 
wl=al, 
w2=a2; 
deltas=delta; 
end 


end 
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4. SOLVE2B.M 


% Function Solve2b calculates the required time to drive the states to the switching 
% surface or to the switching curve processing the given states and passes these values 
% to the function solvelb 
% Written by Serhat Balkan 12 April 1994 
function [al,a2,delta] = solve2b(x1,x2,delta); 
% Use the first two equations of Eqn.(4.33) to find wl, and w2 (al and a2 corresponds to 
% wl and w2 respectively) 
al=delta*x 1+1+0.5*sqrt(2*(x 1%2)+4* delta*x 1-2*delta*x2); 
a2=2*al-delta*x 1-1, 
% Eliminating any complex value 
if imag(al) ~= 0; 
delta=-delta; 
al=delta*x1+1+0.5*sqrt(2*(x1%2)+4* delta*x 1-2 *delta*x2): 
a2=2*al-delta*x1-1; 


end 
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